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BACKGROUND OF THE INVENTION 

1 • Technical Field 

This invention relates generally to an apparatus and 
method for transforming perspective-distorted circular 
field of view images into non-distorted, normal 
perspective images having various orientations, 
rotations, and magnifications within the field of view. 

2 . Related Information 

Camera viewing systems are used in abundance for 
surveillance, inspection, security, and remote sensing. 
Remote viewing is critical, for example, for robotic 
manipulation tasks. Close viewing is necessary for 
detailed manipulation tasks wile wide-angle viewing aids 
positioning of the robotic system to avoid collisions 
with the work space. Most of these systems use 
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either a fixed-mount camera with a limited 
viewing field to reduce distortion, or they 
utilize mechanical pan-and-tilt platforms and 
mechanized zoom lenses to orient the camera and 
magnify its image. In the applications where 
orientation of the camera and magnification of 
its image are required, the mechanical solution 
is large in size and can subtend a significant 
volume making the viewing system difficult to 
conceal or use in close quarters. Several 
cameras are usually necessary to provide 
wide-angle viewing of the work space. 

In order to provide a maximum amount of 
viewing coverage or subtended angle, mechanical 
pan/tilt mechanisms usually use motorized 
drives and gear mechanisms to manipulate the 
vertical and horizontal orientation. An 
example of such a device is shown in U.S. 
Patent Number 4,728,839 issued to J.B. 
Coughlan, et al, on March 1, 1988. Collisions 
with the working environment caused by these 
mechanical pan/tilt orientation mechanisms can 
damage both the camera and the work space and 
impede the remote handling operation. 
Simultaneously, viewing in said remote 
environments is extremely important to the 
performance of inspection and manipulation 
activities. 

Camera viewing systems that use internal 
optics to provide wide viewing angles have also 
been developed in order to minimize the size 
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and volume of the camera and the intrusion into 
the viewing area. These systems rely on the 
movement of either a mirror or prism to change 
the tilt-angle of orientation and provide 
mechanical rotation of the entire camera to 
change the pan angle of orientation. 
Additional lenses are used to minimize 
distortion. Using this means, the size of the 
camera orientation system can be minimi zed , but 
"blind spots" in the center of the view result. 
Also, these systems typically have no means of 
magnifying the image and or producing multiple 
images from a single camera. 

References that may be relevant to the 
evaluation of the present invention are U. S. 
Patent Numbers: 4,772,942 issued to M. J. Tuck 
on September 20, 1988; 5,023,725 issued to D. 
McCutchen on June 11, 1991; 5,067,019 issued to 
R. D. Juday on November 19, 1991; and 5,068,735 
issued to K. Tuchiya, et al on November 26, 
1991. 

Accordingly, it is an object of the 
present invention to provide an apparatus that 
can provide an image of any portion of the 
viewing space within a selected f ield-of-view 
without moving the apparatus, and then 
electronically correct for visual distortions 
of the view. 

It is another object of the present 
invention to provide horizontal orientation 
(pan) , vertical orientation (tilt) and 



rotational orientation (rotation) of the 
viewing direction with no moving mechanisms. 

It is another object of the present 
invention to provide the ability to magnify or 
scale the image (zoom in and out) 
electronically . 

It is another object of the present 
invention to provide electronic control of the 
image intensity (iris level) . 

It is another object of the present 
invention to be able to accomplish pan, tilt, 
zoom, rotation, and iris adjustments with 
simple inputs made by a lay person from a 
joystick, keyboard controller, or computer 
controlled means. 

It is also an object of the present 
invention to provide accurate control of the 
absolute viewing direction and orientations 
using said input devices. 

A further object of the present invention 
is to provide the ability to produce multiple 
images with different orientations and 
magnifications simultaneously from a single 
input image. 

Another object of the present invention is 
to be able to provide these images at real-time 
video rates, e.g. thirty transformed images per 
second, and to support various display format 
standards such as the National Television 
Standards Committee RS-170 signal format and/or 
higher resolution formats currently under 



development. 

It is also an object of the present 
invention to provide a system that can be used 
for automatic or manual surveillance of 
selected environments, with optical views of 
these environments corrected electronically to 
remove distortion so as to facilitate this 
surveillance. 

These and other objects of the present 
invention will become apparent upon 
consideration of the drawings hereinafter in 
combination with a complete description 
thereof . 

Disclosure of the Invention 

In accordance with the present invention, 
there is provided an omnidirectional viewing 
system that produces the equivalent of pan, 
tilt, zoom, and rotation within a selected 
f ield-of-view with no moving parts. Further, 
the present invention includes means for 
controlling this omnidirectional viewing in 
surveillance applications. This device 
includes a means for digitizing an incoming or 
prerecorded video image signal, transforming a 
portion of the video image based upon operator 
or preselected commands, and producing one or 
more output images that are in correct 
perspective for human viewing. In one 
embodiment, the incoming image is produced by a 
fisheye lens which has a wide angle 
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f ield-of-view. This image is captured into an 
electronic memory buffer. A portion of the 
captured image, either in real time or as 
prerecorded, containing a region-of -interest is 
transformed into a perspective correct image by 
an image processing computer. The image 
processing computer provides direct mapping of 
the image region-of-interest into a corrected 
image using an orthogonal set of transformation 
algorithms. The viewing orientation is 
designated by a command signal generated by 
either a human operator or computerized input. 
The transformed image is deposited in a second 
electronic memory buffer where it is then 
manipulated to produce the output image or 
images as requested by the command signal. 
This is coupled with appropriate alarms and 
other outputs to provide a complete 
surveillance system for selected environments. 

Brief Description of the Drawings 

Figure ^1 shows a schematic block diagram 
of the signal processing portion of the present 
invention illustrating the major components 
thereof . 

Figure^2 is an exemplary drawing of a 
typical fisheye image used as input by the 
present invention. Lenses having other f ield- 
of-view values will produce images with similar 
distortion, particularly when the f ield-of-view 
is about eighty degrees or greater. 



Figure N 3 is an exemplary drawing of the 
output image^ after correction for a desired 
image orientation and magnification within the 
original image. 

Figure 4 is a schematic diagram of the 
fundamental geometry that the present invention 
embodies to accomplish the image 
t r ans f ormat ion . 

Figure 5 is a schematic diagram 
demonstrating the projection of the object 
plane and position vector into image plane 
coordinates. 

Figure 6 is a block diagram of the present 
invention as utilized for 
sur ve i 1 lance / inspect ion app 1 icat ions 
incorporating the basic transformation of video 
images obtained with, for example, wide angle 
lenses to correct for optical distortions due 
to the lenses, together with the control of the 
surveillance/ inspection and appropriate alarm 
systems . 

Figures 7 A and 7B, together, show a logic 
flow diagram illustrating one specific 
embodiment of controller operation for manual 
and automatic surveillance operations of the 
present invention. 

Best Mode for Carrying Out the Invention 

In order to minimize the size of the 
camera orientation system while maintaining the 
ability to zoom, a camera orientation system 
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that utilizes electronic image transformations 
rather than mechanisms was developed. While 
numerous patents on mechanical pan-and-tilt 
systems have been filed, no approach using 
strictly electronic transforms and wide angle 
optics is known to have been successfully 
implemented. In addition, the electro-optical 
approach utilized in the present invention 
allows multiple images to be extracted from the 
output of a single camera. These images can be 
then utilized to energize appropriate alarms, 
for example, as a specific application of the 
basic image transformation in connection with a 
surveillance system. As utilized herein, the 
term "surveillance" has a wide range including, 
but not limited to, determining ingress or 
egress from a selected environment. Further, 
the term "wide angle" as used herein means a 
f ield-of-view of about eighty degrees or 
greater. Motivation for this device came from 
viewing system requirements in remote handling 
applications where the operating envelop of the 
equipment is a significant constraint to task 
accomplishment . 

The principles of the optical transform 
utilized in the present invention can be 
understood by reference to the system 10 of 
Figure 1. (This is also set forth in the 
afore-cited U. S. Patent Application Serial 
Number 07/699,366 that is incorporated herein 
by reference.) Shown schematically at 11 is a 



wide angle, e.g., a fisheye, lens that provides 
an image of the environment with a 180 degree 
f ield-of-view. The lens is attached to a 
camera 12 which converts the optical image 
into an electrical signal. These signals are 
then digitized electronically 13 and stored in 
an image buffer 14 within the present 
invention. An image processing system 
consisting of an X-MAP and a Y-MAP processor 
shown as 16 and 17, respectively, performs the 
two-dimensional transform mapping. The image 
transform processors are controlled by the 
microcomputer and control interface 15. The 
microcomputer control interface provides 
initialization and transform parameter 
calculation for the system. The control 
interface also determines the desired 
transformation coefficients based on 
orientation angle, magnification, rotation, and 
light sensitivity input from an input means 
such as a joystick controller 22 or computer 
input means 23. The transformed image is 
filtered by a 2-dimensional convolution filter 
18 and the output of the filtered image is 
stored in an output image buffer 19. The 
output image buffer 19 is scanned out by 
display electronics 20 to a video display 
device 21 for viewing. 

A range of lens types can be accommodated 
to support various fields of view. The lens 
optics 11 correspond directly with the 



10 

mathematical coefficients used with the X-MAP 
and Y-MAP processors 16 and 17 to transform the 
image. The capability to pan and tilt the 
output image remains even though a different 
maximum field of view is provided with a 
different lens element. 

The invention can be realized by proper 
combination of a number of optical and 
electronic devices. The lens 11 is exemplified 
by any of a series of wide angle lenses from, 
for example, Nikon, particularly the 8mm F2.8. 
Any video source 12 and image capturing device 
13 that converts the optical image into 
electronic memory can serve as the input for 
the invention such as a Videk Digital Camera 
interfaced with Texas Instrument's TMS 34061 
integrated circuits. Input and output image 
buffers 14 and 19 can be constructed using 
Texas Instrument TMS44C251 video random access 
memory chips or their equivalents. The control 
interface can be accomplished with any of a 
number of microcontrollers including the Intel 
80C196. The X-MAP and Y-MAP transform 
processors 16 and 17 and image filtering 19 can 
be accomplished with application specific 
integrated circuits or other means as will be 
known to persons skilled in the art. The 
display driver can also be accomplished with 
integrated circuits such as the Texas 
Instruments TMS34061. The output video signal 
can be of the NTSC RS-170, for example, 
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compatible with most commercial television 
displays in the United States. Remote control 
22 and computer control 23 are accomplished via 
readily available switches and/ or computer 
systems that also will be well known. These 
components function as a system to select a 
portion of the input image (fisheye or other 
wide angle) and then mathematically transform 
the image to provide the proper prospective for 
output. The keys to the success of the 
invention include: 

(1) the entire input image need not be 
transformed, only the portion of interest; 

(2) the required mathematical transform is 
predictable based on the lens characteristics; 
and 

3) calibration coefficients can be 
modified by the end user to correct for any 
lens/camera combination supporting both new and 
retrofit applications. 

The transformation that occurs between the 
input memory buffer 14 and the output memory 
buffer 19, as controlled by the two coordinated 
transformation circuits 16 and 17, is better 
understood by referring to Figures 2 and 3. 
The image shown in Figure 2 is a rendering of 
the image of a grid pattern produced by a 
fisheye lens. This image has a f ield-of-view 
of 180 degrees and shows the contents of the 
environment throughout an entire hemisphere. 
Notice that the resulting image in Figure 2 is 
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significantly distorted relative to human 
perception. Similar distortion will be 
obtained even with lesser f ield-of-view lenses. 
Vertical grid lines in the environment appear 
in the image plane as 24a, 24b, and 24c. 
Horizontal grid lines in the environment appear 
in the image plane as 25a f 25b, and 25c. The 
image of an object is exemplified by 26. A 
portion of the image in Figure 2 has been 
corrected, magnified, and rotated to produce 
the image shown in Figure 3. Item 27 shows the 
corrected representation of the object in the 
output display. The results shown in the image 
in Figure 3 can be produced from any portion of 
the image of Figure 2 using the present 
invention. The corrected perspective of the 
view is demonstrated by the straightening of 
the grid pattern displayed in Figure 3. In the 
present invention, these transformations can be 
performed at real-time video rates (e.g., 
thirty times per second) , compatible with 
commercial video standards. 

The transformation portion of the 
invention as described has the capability to 
pan and tilt the output image through the 
entire field of view of the lens element by 
changing the input means, e.g. the joystick or 
computer, to the controller. This allows a 
large area to be scanned for information as can 
be useful in security and surveillance 
applications. The image can also be rotated 
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through any portion of 360 degrees on its axis 
changing the perceived vertical of the 
displayed image. This capability provides the 
ability to align the vertical image with the 
gravity vector to maintain a proper perspective 
in the image display regardless of the pan or 
tilt angle of the image. The invention also 
supports modifications in the magnification 
used to display the output image. This is 
commensurate with a zoom function that allows a 
change in the field of view of the output 
image. This function is extremely useful for 
inspection and surveillance operations. The 
magnitude of zoom provided is a function of the 
resolution of the input camera, the resolution 
of the output display, the clarity of the 
output display, and the amount of picture 
element (pixel) averaging that is used in a 
given display. The invention supports all of 
these functions to provide capabilities 
associated with traditional mechanical pan 
(through 180 degrees) , tilt (through 180 
degrees) , rotation (through 360 degrees) , and 
zoom devices. The digital system also supports 
image intensity scaling that emulates the 
functionality of a mechanical iris by shifting 
the intensity of the displayed image based on 
commands from the user or an external computer. 

The postulates and equations that follow 
are based on the image transformation portion 
of the present invention utilizing a wide angle 
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lens as the optical element. These also apply 
to other f ield-of-view lens systems. There are 
two basic properties and two basic postulates 
that describe the perfect wide angle lens 
system. The first property of such a lens is 
that the lens has a 2n steradian f ield-of-view 
and the image it produces is a circle. The 
second property is that all objects in the 
f ield-of-view are in focus, i.e. the perfect 
wide angle lens has an infinite depth-of-f ield. 
The two important postulates of this lens 
system (refer to Figures 4 and 5) are stated as 
follows: 

Postulate l: Azimuth angle invariability 

- For object points that lie in a content plane 
that is perpendicular to the image plane and 
passes through the image plane origin, all such 
points are mapped as image points onto the line 
of intersection between the image plane and the 
content plane, i.e. along a radial line. The 
azimuth angle of the image points is therefore 
invariant to elevation and object distance 
changes within the content plane. 

Postulate 2: Equidistant Projection Rule 

- The radial distance, r, from the image plane 
origin along the azimuth angle containing the 
projection of the object point is linearly 
proportional to the zenith angle p, where p is 
defined as the angle between a perpendicular 
line through the image plane origin and the 
line from the image plane origin to the object 
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point. Thus the relationship: 

r = kp (1) 

Using these properties and postulates as 
the foundation of the lens system, the 
mathematical transformation for obtaining a 
perspective corrected image can be determined. 
Figure 4 shows the coordinate reference frames 
for the object plane and the image plane. The 
coordinates u,v describe object points within 
the object plane. The coordinates x,y,z 
describe points within the image coordinate 
frame of reference. 

The object plane shown in Figure 4 is a 
typical region of interest to determine the 
mapping relationship onto the image plane to 
properly correct the object. The direction of 
view vector, DOV[x,y , z] f determines the zenith 
and azimuth angles for mapping the object 
plane, UV, onto the image plane, XY. The 
object plane is defined to be perpendicular to 
the vector, DOV[x,y,z]. 

The location of the origin of the object 
plane in terms of the image plane [x,y,z] in 
spherical coordinates is given by: 



x = 

y = 

z = 



D sinP cos3 
D sinp sind 
D cosp 



(2) 



5 



10 



15 



20 



where D = scaler length from the image plane 
origin to the object plane origin, P is the 
zenith angle, and d is the azimuth angle in 
image plane spherical coordinates. The origin 
of object plane is represented as a vector 
using the components given in Equation 1 as: 

DOV[x,y,z] = [ Dsinpcosd, Dsinpsin3, Dcosp] (3) 

DOV[x,y,z] is perpendicular to the object 
plane and its scaler magnitude D provides the 
distance to the object plane. By aligning the 
YZ plane with the direction of action of 
DOV[x,y,z], the azimuth angle d becomes either 
90 or 270 degrees and therefore the x component 
becomes zero resulting in the DOV[x,y,z] 
coordinates : 

D0V[x,y,z] = [ 0, -DsinP, Dcosp] (4) 

Referring now to Figure 5, the object 
point relative to the UV plane origin in 
coordinates relative to the origin of the image 
plane is given by the following: 



x = 



u 



y = v cosp 
z = v sinp 



(5) 
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therefore, the coordinates of a point P(u,v) 
that lies in the object plane can be 
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represented as a vector P[x,y,z] in image plane 
coordinates : 



where P[x,y f z] describes the position of the 
object point in image coordinates relative to 
the origin of the UV plane. The object vector 
0[x,y, z] that describes the object point in 
image coordinates is then given by: 

0[x,y,z] - DCV[x,y,z] + P[x,y,z] (7) 
0[x,y,z] = [ u, vcosP - Dsinp, vsinP + Doosp] (8) 

Projection onto a hemisphere of radius R 
attached to the image plane is determined by 
scaling the object vector 0[x,y,z] to produce a 
surface vector S[x,y,z]: 



By substituting for the components of 
0[x,y,z] from Equation 8, the vector S[x,y,z] 
describing the image point mapping onto the 
hemisphere becomes: 



P[x,y,z] = I u, vcosp, vsinp) 



(6) 



S[X ' y ' Z] = |0[x,y,z]| 



(9) 



S[x,y,z] = 



RO[u> (vcosfi-Dsinfi), (vsinB+Dcosfi)] 



(10) 



V u 2 +(vcosB-DsinB) 2 +(vsinB+DcosB) : 



The denominator in Equation 10 represents 
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the length or absolute value of the vector 
0[x,y,z] and can be simplified through algebraic 
and trigonometric manipulation to give: 



cr ^ R 0t u > (vcosB-DsinB), (vsinfi+DcosB)] f . 

V u 2 +v 2 +D 2 



From Equation 11, the mapping onto the 
two-dimensional image plane can be obtained for 
both x and y as: 

»= , *" (12) 

V u 2 +v 2 +D 2 



_ R(vcosB-DsinB) ^ 
V u 2 +v 2 +D 2 



Additionally, the image plane center to 
object plane distance D can be represented in 
terms of the image circular radius R by the 
relation: 

D=mR (14) 

where m represents the scale factor in 
radial units R from the image plane origin to 
the object plane origin. Substituting Equation 
14 into Equations 12 and 13 provides a means 
for obtaining an effective scaling operation or 
magnification which can be used to provide zoom 
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operation. 



Ru 



(15) 



x = 



V u 2 +v 2 +m 2 R 2 



y = 



R(vcosfi-mRsinfi) 



(16) 



V u 2 +v 2 +m 2 R 2 



Using the equations for two-dimensional 
rotation of axes for both the UV object plane 
and the XY image plane the last two equations 
can be further manipulated to provide a more 
general set of equations that provides for 
rotation within the image plane and rotation 
within the object plane. 

Rr uA-vB+mRsinBsin9 ] 




R[ uC-vD-mRsinficos9 

y= /— — „ ^ „ 




(18) 



where : 



A = (cos0cos3 - sin0sindcosp) 

B = (sin0cos3 + cos0sin3cosp) 

C = (cos0sin3 + sin0cosdcosP) 

D = (sin0sind - cos0cos3cosP) 



(19) 



and where: 



R = radius of the image circle 
P = zenith angle 

d - Azimuth angle in image plane 
0 = Object plane rotation angle 
m = Magnification 
u,v = object plane coordinates 
x,y = image plane coordinates 

The Equations 17 and 18 provide a direct 
mapping from the UV space to the XY image space 
and are the fundamental mathematical result 
that supports the functioning of the present 
omnidirectional viewing system with no moving 
parts. By knowing the desired zenith, azimuth, 
and object plane rotation angles and the 
magnification, the locations of x and y in the 
imaging array can be determined. This approach 
provides a means to transform an image from the 
input video buffer to the output video buffer 
exactly. Also, the image system is completely 
symmetrical about the zenith, therefore, the 
vector assignments and resulting signs of 
various components can be chosen differently 
depending on the desired orientation of the 
object plane with respect to the image plane. 
In addition, these postulates and mathematical 
equations can be modified for various lens 
elements as necessary for the desired 
f ield-of-view coverage in a given application. 

The input means defines the zenith angle, 
P, the azimuth angle, d, the object rotation, 
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0, and the magnification, m. These values are 
substituted into Equations 19 to determine 
values for substitution into Equations 17 and 
18. The image circle radius, R, is a fixed 
value that is determined by the camera lens and 
element relationship. The variables u and v 
vary throughout the object plane determining 
the values for x and y in the image plane 
coordinates. 

From the foregoing, it can be seen that a 
wide angle lens provides a substantially 
hemispherical view that is captured by a 
camera. The image is then transformed into a 
corrected image at a desired pan, tilt, 
magnification, rotation, and focus based on the 
desired view as described by a control input. 
The image is then output to a television 
display with the perspective corrected. 
Accordingly, no mechanical devices are required 
to attain this extensive analysis and 
presentation of the view of an environment 
through 180 degrees of pan, 180 degrees of 
tilt, 360 degrees of rotation, and various 
degrees of zoom magnification. 

As indicated above, one application for 
the perspective correction of images obtained 
with a motionless wide angle camera is in the 
field of surveillance. The term "surveillance" 
is meant to include inspection and like 
operations as well. It is often desired to 
continuously or periodically view a selected 
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environment to determine activity in that 
environment. The term "environment" is meant 
to include such areas as rooms, warehouses, 
parks and the like. This activity might be, 
for example, ingress or egress of some object 
relative to that environment. It might also be 
some action that is taking place in that 
environment. It may be desired to carry out 
this surveillance either automatically at the 
desired frequency (or continuously), or upon 
demand by an operator. The size of the 
environment may require more than one 
motionless camera for complete surveillance. 

Such a surveillance system is indicated 
generally at 30 of Figure 6. A video camera 
unit 32, including a wide angle lens 31, is 
utilized to view the selected environment (or 
portion of the environment) , with the output 
therefrom being electrical signals related to 
the elements as seen by the camera system. 
These signals, when present, are either 
directly presented to an image transformation 
system 33 (the components of Figure 1 without 
the camera/ lens and the TV monitor thereof) or 
to a videotape recorder 34 for subsequent 
processing in the image transformation system 
33. This permits evaluation during "post 
event" review as well as a review of events 
that occur in real time. It will be understood 
that additional camera-lens units in an 
environment, as well as videotape recorders, 
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can be utilized as indicated at 35. 

Various external elements are utilized to 
govern the operation of the transformation 
system. For example, appropriate discrete 
switches 36 are used for the selection of the 
environment or portion of the environment to be 
monitored. These switches can be positioned 
(and operated) either at the control center or 
at the environment (or other remote location) . 
When positioned in the environment, these 
switches can indicate some action occurring in 
the environment (door opening, window breaking, 
etc.) with the result that the virtual camera 
of the system is directed to the point of 
interest and then signal an external alarm for 
creating an audible alarm if desired. Also, 
alarm conditions can activate the video tape 
recorder discussed below. Since the system 
monitors the presence of an incoming video 
signal, the device can signal an alarm when the 
incoming video signal is disrupted. Where the 
monitoring is to be preselected, one input can 
be a computer 38. Another form of control is 
through the use of operator controls 40 such 
that the operator can select at any time the 
operation of the transformation. Options that 
are available in either of these types of 
control are "Quad display" (either through the 
control by the computer 38 or the operator 
controls 40) wherein four displays occur on a 
monitor. Another option available through 
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either control is that of "tweening" which is a 
selection of moving the effective view of the 
camera incrementally between active points or 
switching between active cameras within the 
environment. As previously described, these 
inputs are used also for selecting pan, tilt/ 
zoom and rotation. 

The output of the transformation system 33 
is typically in digital format. As such, this 
output can control alarm enunciators 42 
positioned at any location, or other forms of 
discrete alarms 44. They can also activate a 
videotape recording machine 46. In addition, 
the alarms 44 can be used to detect and 
announce loss of video signal, and permit 
external interrogation (manual or automated) of 
system status by the computer interface of the 
system parameters including component or power 
failure. Such interrogation would include 
verification of operation, video input, pan- 
tilt-rotation angles, magnification and setup 
parameters. As in the system of Figure 1, this 
surveillance system 30 provides for pictorial 
environment display on a TV-type monitor 48 
and/or on the tape of the recording machine 46. 

Figures 7A and 7A, jointly, form a logic 
flow diagram that illustrates how one specific 
embodiment of the controller 30 can perform 
manual and automatic surveillance activities. 
A decision is made at 50 as to whether the 
system is under computer (external) control 



(see 38 of Figure 6) or manual (internal) 
control. If under computer operation, the 
camera orientations and magnifications are 
communicated directly to the system for action 
at 52. In the event of internal control, it is 
next determined if any environmental switches 
are closed as at 54. These switches typically 
are hard wired, magnetic infrared or other 
forms that indicate a change in the environment 
in a certain location. The choice of a 
specific type of switch for each application 
will be known by persons skilled in the art. 
These changes (if "YES") give rise to signals 
at 56 to point its visual camera in the 
direction of interest and then signal an 
external alarm for creating an audible alarm 42 
and/ or turning on the video tape recorder 34. 

After initiating these steps, or if the 
answer is "NO" at 54, the switches on the 
unit's control panel are read at 58 to 
determine the configuration and display actions 
needed. "Quad display" (either four displays 
or one display on the monitor 48) is checked at 
60 and, if the four displays are desired (the 
"YES"), this is initiated at 62. If "tweening" 
(incremental effective movement of a camera or 
switching between cameras) is desired, this is 
checked at 64 and the appropriate selection is 
made at 66. 

Inputs for pan, tilt, zoom and rotation 
are interpreted at 68 and applied to the 
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presently active display camera. Every user 
interaction resets the scan timer at 70 so that 
while the user is in control , no virtual camera 
change is occurring. When the scan time 
reaches zero, as monitored at 72, the next 
camera is made active and the image being 
displayed changes direction and/ or content as 
at 74 to thereby update operation as at 52. 

From the foregoing, it will be understood 
by those versed in the art that an advanced 
surveillance system has been provided. This 
system utilizes at least one motionless video 
camera, having a wide angle lens, within the 
environment where surveillance is desired. The 
perspective of images obtained with the 
lens /camera are corrected through 
transformation according to the technology of 
S. N. 07/699,366 either directly or after 
storage in a videotape recorder. Many 
operational conditions are selectable including 
tilt, pan, zoom and rotation. Further, multi- 
image displays can be obtained, and the images 
can be incrementally scanned or switching 
between cameras are other options. The system 
provides for automatic operation coupled with 
user operation if desired. 

While certain specific elements of 
construction are indicated throughout the 
description of the present invention, these are 
given for illustration and not for limitation. 
Thus, the invention is to be limited only by 




the appended claims and their equivalents. 



